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1.  STATEUQTT  OP  THE  PROBLEM 


One  of  the  problems  which  arises  when  a  computer  Is  utilized  In  data- 
anilyns  systems  is  tho  conversion  ol  the  Incoming  data  to  a  lorn  which  can 

bo  used  is  Input  to  the  computer.  When  a  digital  computer  Is  used  in  the 

system,  this  conversion  Is  usually  mido  by  some  sort  of  analog-to-dlgl tal 
converter  which  transforms  tho  incoming  electrical  s.gnal  Into  a  now  signal 
uf  a  more  usoiblc  fora,  for  Instanco,  this  no  signal  can  bo  fed  directly 
Into  tho  computer  through  some  type  of  line  coupler,  or  be  used  to  punch  a 
set  of  coded  numbers  on  paper  tape  or  cards  which  can  be  input  to  the  computer 
at  a  later  t imu . 

In  many  cases  til"  analysis  to  be  performed  Is  statistical  in  nature  III  as 
much  as  tho  comput'd  output  is  tho  value  of  certain  statistics  which  enables 
tho  experimenter  to  make  decisions  about  the  phenomenon  being  observed.  Those 

decisions  should  alwiys  bo  weighed  by  acknowledging  the  errors  which  are  In¬ 

herent  in  a  system  of  this  type.  In  this  ease  the  error  Is  introduced  by  the 
hardware  used  m  the  conv  ra.on  process  which  trjnsfi.crs  the  Una  from  analog 
lo  cl  Igl  t  a  1  form . 

Tho  reason  for  this  error  li  the  following:  Initially  the  incoming 
elec  trical  signal  is  sampled  in  time  and  a  n> w  wav.  lorm  is  produced  which  has 
discrete  amplitudes  it  discrete  fine  intervals.  The  magnitude  of  each  of  these 
amplitudes  is  then  "rounded  off"  to  some  predetermined  amplitude  level  which  is 
nearest  to  tho  value  of  the  sampled  amplitude.  This  is  referred  to  as  the 
quant  l  z  it  ton  process  and  the  predetermined  amplitude  levels  are  called  quanti¬ 
zation  levels.  The  combined  process,  sampling  in  time  and  quant Izmg  the  re¬ 
sulting  amplitude  is  called  the  digitizing  process  and  results  tn  a  set  of 
discrete  data  points.  The  computer  uses  this  latter  set  of  points  to  calculate 


certain  statistical  quantailos  which  represent,  in  some  «e"«e,  the  original 
electrical  signal  md  than  lore  the  physical  phenomenon  be  ir.g  studicu. 

The  question  which  arise*  is  whether  or  not  the  computed  . ••M-.Ucs  arc 
in  1  act  representative  ol  the  true  value*  Ol  the  statistic*  which  .ould  be 
Obtained  11  It  were  possible  to  compute  the  m  lor  the  incoming  electrical  Slg-il- 
By  simulating  »hc  digiimng  p.ocess  on  a  digital  computer  md  op.ntl-n  on 
simple,  known  wavelortss  iht*  piper  allespts  to  develop  a  technique  which  mgM 
prove  useful  in  investigating  these  problems. 
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3.  SIMPLIFICATION  OF  THE  PROBLEM 

It  hi*  been  pointed  out  In  the  previous  section  that  the  signal  trant- 
to mat  Ion  of  primary  Interest  1*  the  digitising  process.  In  particular  It  Is 
desirable  to  investigate  tho  effect  which  the  ina log- to-digl tal  converter  has 
In  perturbing  tho  values  o(  certain  statistics  fro*  their  true  values.  One  way 
of  attacking  this  problem  Is  an  experimental  one  whereby  the  analog  of  the  actual 
sampling  and  quantising  process  Is  developed  as  a  computer  program.  This  program 
can  then  be  uued  to  operate  on  the  mat  he  mat 1  in  l  analog  of  the  waveform  under 
consider  it  lor,  to  produce  a  new  sc>  of  .‘ata  points  which  npri'tinli  tho  quantized 
amplitudes  at  successive  sample  tlo.es  Using  this  data  the  simple  statistics 
can  b«  calculated  and  compared  with  the  true  valuis  »hnh,  in  this  case,  can 
be'  calculated  directly  using  the  mathemittcil  expression  for  the  incoming  wave¬ 
form.  This  procedure'  can  be-  repeated  for  miny  eomhtn it  tons  or  sampling  rite's 
and  quinti/mg  levels  until  some  tgr*  <  m.  nt  or  lack  ol  agree  me  nt  botwe-en  I  he  two 
sets  ol  results  cm  be-  determined. 

Figures  3  - 1 1  and  J.lb  show  she  »  m  lone  wliieh  result  »h.  n  the  digitizing 
process  is  applied  to  i  sine  save  sup.  imposed  on  a  steam  v  ilae.  It  is  lairly 
obvious  1  re>m  e  ven  the  «i  simple  iketi  hi  e  Inal  ill.  eligltlzeo  wivefnim  having  a 
larger  number  of  samples  and  a  larger  aumlM-r  e>l  qti  ml  e/al  lean  1*  ve  ts  '  resemble  s" 
metre  rlo«e-ly  the  original  sine  wave.  II  se  .  ms  reasonable  In  -ay  thi*.  the-  statis¬ 
tics  in  this  litter  c.t-f  might  hive  vilei.s  miter  lei  ih>  line  value  s  c*le  ulatert  on 
tho  basis  of  the  original  waveform. 

Throughout  the'  remainder  of  this  piper  only  the  sine  wave-  will  be  eonsidt  i  ■  .1  . 
This  miy  seem  to  be  a  gross  simplification  to  mike-  bul  if  any  other  p.-rmau 
waveform  is  to  be  used  as  m  input  signal  it  ran  be  Fourier  analyzed  inlet  i  -un 
of  sine  waves,  therefore  be  lore  any  siiteir.ent  can  be  mule  r.  garding  the-  1  i t* 
of  the'  digitizing  process  on  more  gencril  wave  loins,  it  is  necessary  t.>  ex-ium 
the  else  ol  the  single  sine  wive  in  del  ill.  Sin.  e  the  Fouriei  sell  s  is  i  si;; 


Figure  2 , lh 

T(x)»  A  s i no (x* b) * D,  A,U,  t>  x-iMist.tnl 

Appmxln.i  Ic  »ivof<'rrat  bt.Unoil  usinu  Ihe  <|U.inl  1 /.  i  n^/>  ;»»U>  l  lr>K 
Technique 
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of  sine  waves,  a  linear  operation,  the  effects  on  the  statistic!*  for  the 
original  periodic  wjvcforu  can  be  expressed  as  the  sun  of  the  c fleets  obtained 
for  each  component  sine  wave. 

U  The  Sampling  Process 

The  sampling  process  la  nothing  more  than  a  quantization  of  the  argument 
of  the  function  which  represents  the  Incoming  waveform,  in  this  case  the  sinu 
wave.  This  process  is  subject  to  the  constraints  imposed  by  the  well-known 
.amp  ling  Theorem1  which  gives  the  relation  between  the  rate  at  which  a  signal 
varies  and  the  number  or  sampling  pulses  needed  lo  reconstruct  it.  I ri  parti¬ 
cular  the  Sampling  Theorem  iivs  that  the  power  spectra  uf  the  stapled  and  un¬ 
sampled  waveforms  ire  the  same  provided  certain  constraints  on  the  sampling  fro- 
que-nev  are  satisfied  When  the  power  spectra  arc  the  same  then  the  first  two 
statistical  moments  are  the  same.  Since  the  present  work  ml.  «  use  of  only  the 
first  two  statistical  moments,  the  constraints  imposed  on  the  simpling  frequency 
by  thu  1  amp  ling  Theorem  wall  h  avc  to  be  satisfied. 

The  reason  for  considering  only  the  first  and  Second  statistical  moments 
IS  Ihu  following  !(  Che  incoming  wivelorm  represents  a  voltage  or  a  current 
then  the  tarst  moment,  called  the  s  imp!,  mein,  represents  the  lx;  component  of 
that  voltage  or  current.  T-e  second  moment  represent*  the  total  power  which  that 
voltage  or  current  would  dissipate  in  a  l  ohm  resistor.  fh.  square  root  of  this 
quantity  is  the  HMS  value  of  that  voltage  or  current.  Subtracting  the  square  of 
the  sample  mein  from  (ho  second  moment  gives  th-  alternating  power  which  that 
waveforn  would  dissipate  mil  ohm  resistor-  The  squar.  root  of  this  quantity 
gives  the  AC.  component  ol  that  waveform.  Cone  quen  t  ly  since  electrical  signals 
are  usually  ch  ir  act  e  r:  /  el  bv  their  average,  peak,  and  KVS  values,  only  the  first 


and  second  moments  nee  el  be  studied. 


To  simplify  tho  analysis  which  follows,  the  incoming  wivoform  is  considered 
to  hive  soro  mein  value.  Thst  is,  tho  first  moment  is  assumed  to  bo  zero.  There¬ 
fore  only  the  sinusoidal  component  will  bo  studied. 

After  the  waveform  has  beer,  sampled,  each  amplitude  is  perturbed  by  'ho 
quantization  process  and  this  in  turn  will  perturb  the  value  of  the  simple 
statistic.  Consequently  even  if  tho  constraint  on  the  sampling  frequency  is 
satisfied,  as  required  by  tho  Sampling  Theorem,  this  will  no  longer  be  t  sufficient 
condition  to  guarantee  tho  equivalence  of  the  simple  values  and  the  truo  values 
of  tho  statistics.  However,  the  constraint  does  provide  i  low*  r  bourd  on  the 
simpling  frequency  since,  if  ttnru  were  no  quant  iz  ition,  the  theorem  would  b« 
satisfied  and  the  values  of  the  statistics  would  be  the  sum  . 

If  f  IS  the  highest  frequency  component  or  the  bandwidth  of  th*  incoming 

Q 

signal  and  if  f ^  is  the  rate  it  which  the  simples  are  taken,  thi-n  the  Sampling 
Theorem  requiras  that 


i  •  :if  (an 

s  m 

That  IS,  at  lent  Uf^  uniformly  spiced  samples  are  required  every  soeo"d  to 
reproduce  the  statistic*  ut  the  simphd  waveform,  wh«  re  tin  ainplituda  *  at  <  uh 
simple-  time  hive  not  lion  perturbed  by  the  quantization  process.  Const  quent  lv 
it  will  be  mcvsstrv  to  specify  the  bandwidth  of  the  incoming  signil  so  tha*.  tho 
lower  bound  on  the  sampling  rate  c m  be  determined.  This  is  i  particul  arly  simple 
■sitter  (or  the  cise  under  consideration  since  the  sir*e  w.avc  is  defined  by  a  sing’.* 
frequency.  Simpling  must  occur  at  least  twica  that  frequency  resulting  i"  at 
least  two  samples  per  period  Equt'ion  f3.1>  can  b<  rewritten  is 

t  S  f  *hc  re  S  >  2 . 

s  m 


I 


Tho  porlod  bo tween  iimpllng  pulses  is 


The  argument  of  the  function  is  x  where 


x  •-  w  i  and  A  X  w  A  t  •  3ir  f  A  t 
in  «  m 


The  time  between  simplex  is  At  md  therefore 


At 


Therefore  the  simp  ltd  irgumcnt  M 


A  x 


a* 

s 


wht  re  S 


■J 


and 


x  ( l  A  x  >  =~  l  -  l,  J  .  .  S  (Ml 

The  quant  tty  i,  the  number  01  i  inpl>  s  per  period  Is  one  of  the  piramctor* 
of  primary  interest  . 

Since  the  waveforms  which  will  be  considered  throughout  tho  rest  of  tho  pape 
are  periodic,  they  can  ilwtys  be  defined  in  terms  of  the  argument  x.  To  simulate 
the  sampling  process  on  the  computer,  therefore,  It  Is  nett ss try  to  stoiv  tho 
mathematical  description  of  f(x>,  for  all  x  between  0  and  Sir,  and  call  out  those 


amplitudes  given  by  f<2fft /S)  where  the  number  of  samples  to  bo  taken  (l.e.  S) 
hi*  been  specified  at  the  outset  and  l  is  allowed  to  index  through  values  from 
1  to  3  .  The  computer  program  which  was  developed  was  a  direct  application  of 
these  two  steps. 

3.3  The  Quantisation  Process 

The  most  general  equ I -In torv a  1  quantizer  has  the  transfer  characteristics 
•hewn  in  Figure  3.3.  This  quantizer  can  be  decomposed  into  a  system  containing 
shifts,  gain  factory  and  a  unit  quantizer  (AV  .  1,  a  1,  r  -  1>  from  which  i 
mathematical  expression  relating  tho  input  and  output  waveforms  can  be  derived. 
This  his  been  dune  in  the  paper  by  0.  C.  Watts'*.  For  i  he  present  it  is  suffi¬ 
cient  to  utilize  only  the  following  result'  If  f (s >  Is  the  Input  waveform  and 
q(x)  Is  the  quintlzvd  output  wavefurm,  quantization  occurs  when 

In  -  •  |lfx»  |  •  In  ♦  j>  .3V  n  -  0  l  2,  ...  N  <2. 3) 

where  N  is  the  numln  r  of  quantization  levels  on  each  side  ol  the  /oro  a.npliiuUe 
level.  The  resulting  output  Is 


qls> 

r 

If  !<x>  0 

(2  .  »> 

q  (x ) 

•  fUV 

if  fix)  <  0 

12  .3) 

Figure  3.3  illustrates  the  manner  in  which  the’  quantization  levels  are  assigned 
lur  the  simple  case  when  1  -I.  The  quantization  interval  IV  is  l,  V  where  N  is 
actually  only  j  ol  the  total  number  of  quantization  levels  used  since  f  refers 


10 

to  tho  nwbtr  of  luvsls  on  each  sldo  of  tho  *•  ro  voltage  Itvsl. 

Using  Equation*  (3.3),  (1.0,  And  (3.tt)  1C  was  possible  to  aimulat*  tit*, 
quantitation  pn-con*  on  tho  computer.  To  obtain  th*  analog  of  ths  entire 
digit  lung  process  (i.c.  tamp  ling  and  quantising),  It  remains  only  to  combine 
the  two  processes  ju«t  considered.  In  fact,  tnu  only  revision  which  has  to  b« 

Made  it  in  Equation  (3.3)  where  instead  of  qumtlslng  f(n)  for  all  x,  only 
f(2rri/S)  need  be  quint  tied  for  iho  respect  ivo  sample  teguments  which  are  obtained 
when  t  indents  fro*  1  (<i  g.  A  sample  calculation  wilt  be  inns  idem!  nint  in  order 
to  illustrate  the  main  points  ol  the  pending  discussion, 

2.3  Sample  Calculation 

((n)  .  sin(n)  U  ft  a  •.  2f 

dupposi  thsl  f  <x )  is  sampled  at  a  rate  ol  10  simple  pr  mriod,  (t  >'.  •  iu)  and 
.1  total  ol  30  i|Uanl  I  /.at  Ion  levels  lie  used,  (l.e.  N  ID).  Tin  HHIimilll  ol  I  Its 
argument  is 


3  s  *  if  17/  Id  0 . 1  j 7  i  id  i  alls 


fhinfnte  it  e»eh  s  imp  It  lime 


*t  ■  lA»  ♦  (0-13VI)  mil  in t  lor  i  .  1,  J,  3,  ID 

Tht  quantising  Interval  Is 


^  V  1,*  •  1/ IU  0.1 
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The  analog  of  the'  sampling  and  quantizing  process  is  therefore  given  by. 


ii.lfn  -  j)  c 


sin(0.157i > 


O.Kn  * 


0,  1,  ...  10 


i  nd 


q  ( 0 . 137 1 )  «■  O.ln  lor  sin(U.137i)  0 


qf0.|37t)  -  O.ln  tor  sin(0.l57i)  0 

The  resulting  digitized  sim  wave  i «  illustrated  in  figure  2.1.  The  amplitudes 
obtained  at  <  uh  sample  time  and  the  squire  of  each  of  these  amplitudes  were 
summed  over  ill  simple  tinus  and  *he  following  results  were  obtained 

10 

12  q(U  ir»7t)  •  O 
I  1 

£  q*  (0.1371)  0 .  10.1a 

t  I 


Vstng  these  i e*u Its  the  sample  st  it  t  st les  were  calculate  d  is  tollows 


S  emple  me  in  “  q  <  0 . 137l  )  0 

.  I 


1  '  2  2 
-empli  Vettance  .  ■—  «  q  (0.l37i>  -  (sample  mein)  0,101a 


simple  s?»»ulird  tie  v  tit  ton 


/Tmi  0  703 


Using  the  probability  function  for  the  sine-wave  process  tho  truo  moan  and 
variance  can  be  calculated  .  A  measure  of  how  well  the  sample  values  compare 
with  these  true  values  can  then  be  made . 

The  probability  distribution  function  for  tho  sine-wave  process  Is 
(of  Drunck^) 


l  X  ■*  *  1 
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and  the  prolMlii  1 1  ty  density  function  i  s 
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The  graphs  *>f  th»se  functions  are  1 1  lust  r  tied  m  figure  2  j  t'smg  these  re¬ 
lations  the  true  hk  an  is 


1  x(l  )  1 


l 


0 


and  the  second  mom* nl  t- 
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The rt  foie  the  vinan«a  Is 
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ind  this  results  i-  ,a  standard  diviilion  of  i).7i)T 
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iK-n-H  v  function 


!l  a  closer  look  at  the  digitizing  process  for  tho  sine  *  we  Is  taken,  tt 

will  bo  observed  that  when  the  sine  wive  his  zero  phase  It  liwiys  has  zero 

simple  mein  lor  ill  values  ol  S.  for  every  positive  implitudo  there  is  i 
corresponding  negittve  amplitude  of  the  same  valu<  and  the  resulting  sum  will 
therefore  alwiys  be  zero.  If  the  sine  wave  Is  shitted  with  respect  to  the  t  0 
»xis,  then  the  sample  m«an  will  be  zero  only  for  even  values  of  S.  In  both  »  ises, 
when  the  sampled  and  quantized  amplitudes  are  squired,  cancellation  cinnot  occur 
ind  tlie  samplt  variance  his  i  value  which  tn  general  is  not  aquil  to  the  true 
value,  for  ill  S  ind  any  phase.  Dec  disc  zr  ro  phase  hn  been  issiiT.td  for  thi  <tn 
wave  under  consider  it  ion  it  will  In-  necessary  only  to  examine  th*  errors  in  Un¬ 
sample  variance'  since  the  m<  in  is  zero  for  all  S  is  pointed  out  lbove  This  oiror 
is  best  described  m  terms  of  the*  simple  stindard  de-vlitlon  elr.ee  it  has  dimensions 
which  are  more  m*  mingfut  physic  el  lv  II  the  sine  wave  is  a  volt  ige  ,  lor  example, 

the  st  indit'd  tie  vl  it  ion  *tll  ilso  hive  the  dimensions  ol  volts 

In  this  e-  iso  the  pe  teen  t  ige'  error  in  the-  sttndttd  deviation  is 


U.7Q3  -  n  707 
0.707 


loo''’  -0.3tt’» 


When  i  more  general  pc'riodie'  waveform  is  considered  whieh  his  more  tl*.n  one 
frequency  «ompor*nt.  it  is  best  to  redefine  the  picvious  result  in  terms  oi  tin- 
virianee  .  As  his  tliciuy  been  pointed  out  the  variance  corresponds  to  the  if 
power  dissipated  in  i  1  ohm  resistor  when  the  process  x(t)  represents  i  voltage 
or  i  current.  Smee  the  tot  >1  if.  power  of  the  periodic  wiveform  is  the  s»m  ol 
the  powers  ol  e  ich  frequene'v  component,  the  total  virtoue  will  be  the  sum  of  the 
viilitices  of  e  ich  component  sn(  wive.  Miking  use  ol  this  ute  t  It  is.  possible 
to  extend  the  rcsul's  obtained  lor  the  single  tint  wive  c  i  c  to  ptedlet  the  re¬ 
sults  for  slightly  mor«  generil  ci<et». 
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Although  the  computation  Involved  In  obtaining  the  above  results  was  quite 
simple  conceptually,  it  was  very  laborious  ar.d  time  consuming.  Furthermore,  the 
results  wore  based  on  only  one  value  of  S  ar'd  ore  value  of  N,  while  it  is  really 
necessary  to  know  the  behavior  for  miny  values  of  S  and  N.  It  was  possible  to 
obtain  a  rather  large  quintity  of  data  in  a  relatively  short  time  by  programming 
the  computer  to  simulate  the  digitizing  process  in  the  manner  just  described. 

Tho  suction  which  follows  deals  with  the  analysis  of  this  data. 


I 


I 


$ 

f 

3.  EXPERIMENTAL  PnOCEDL’RES  AND  RESULTS  j 

Miking  use  ol  the  computer  Analog  ol  the  digitizing  process  enveloped  in 
the  preceding  fiction  it  was  possible  to  obtun  the  difference  between  the  4 

value's  of  ihe  standard  diviition  calculated  for  tho  unpc rturhe-a  wave-form  and  | 

the  corresponding  quantized  waveform  as  a  function  ol  tho  number  of  quantizing 
levels  over  a  wide  ringe  ol  sampling  rates.  It  was  found  that  these'  differences  j 

(expressed  as  percentage  errors  with  respect  to  tho  true  vilw-l  tended  to  be  - 

iomo  smaller  is  the  number  of  quinrtzatton  levels  increased,  figure-  3.1  is  > 
typical  plot  showing  the  errors  which  were  obtained  when  the-  sampling  rete-  w  is 
fl.xe-d  a*  20  simples  per  period  and  the  number  of  qu  intuition  le-ve  Is  ringed  from 
I  to  23U  In  this  form  it  is  difficult  to  make  efficient  use  of  the  (lit  i 

lor  the  most  part,  this  paper  ts  concerned  with  the  matter  of  Me  meriting 
inv  tendency  which  the  errors  in  the-  st  indaret  deviitton  might  demonstrate  with 
re-spe  e:t  to  the-  v  ilues  eif  3  and  N  I  here- fore*  a  restricting  cri. e  lion,  which  i  .in 
be  used  to  ndUee  the  i|Ualltlty  of  elate  which  has  t>*  be  anilv/eet,  ts  to  oleic  r 
the  maximum  errots  with  lespcet  to  ata  mere  ismg  velue-  of  V.  In  te  fete  nee  to 
figure  3.1,  lor  example,  the  largest  error  obtained  over  tin  entire  tinge-  of  V 
occurs'  »t  V  0.  Uy  efelmition  of  the-  ordering  process ,  the'  --mile  i-  errors  which 
ue  obtained  tor  N  less  than  6  will  be  neglected  !ln-  remaining  errors  our  the 
r  enge-  N  gn  iter  than  ll  ate  sc  mm  it  until  the  next  lerge-t  error  ts  found  In 
this  case  this  occurs  at  N  7  tn  general  the  errors  between  N*  cl  met  V  7 
would  be  neglected,  again  by  de-iinltlon  of  the  ordering  pioecclurc  .  (Infortun  ate-ly 
this  wis  j  trivial  case  because  no  errors  were  obtained  in  this  intert  ill  the 

range  for  V  gte  iter  than  7  is  ’hen  -tinned  for  tho  next  Ingest  error  which. 

In  this  case,  is  e'btaincd  at  N  .-  It.  As  before-  the  «miller  errors  tn  the  tnter- 
vil  between  V  -  7  ,nd  N  H  ere  neglected.  Uy  repeating  this  scif.nir.g  proceduie 
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for  the  regaining  values  of  V  tho  curve  driwn  in  Figure  3  1  is  produced.  Bv 
considering  only  the  error*  given  by  this  curve  it  I*  a  certainty  thr  lor  c  ich 
value  of  N  the  error*  art  either  less  thin  or  ci|iitl  to  the  v»luis  given  by  the 
ordinate  of  that  curve  ■  Obviousl)  any  analysis  based  on  this  cuivt  sill  be  b>sed 
on  worst-CJ*!-  result*. 

It  should  tv  noted  that  this  technique  certainly  does  rot  mike  the  must 
efficient  u*c  of  the  dat i  (in  the  statistical  sense),  but  (or  thi-  preliminary 
Investigation  it  does  reduce  the  quantity  of  citi  to  i  more  si  in  ige  tble  le  ve  1 

Another  curve  »i«  dr  tan  in  ih<  sura  *ay  giving  the  .oi-t-ei-e  result,  .it.  n 
l  (Hi  s  imp  K  s  pi  r  pi  i  lod  »e  re  t  ake  n  (i  >  3  1UU)  Figure  J  2  tlli-tretis  this 

curve-  as  sell  is  (hit  plotted  in  Figure  .)  1  (..rS  20  fh<  strught  line  -  repre¬ 

sent  the  be  s  l  fit  lltieir  tpprox  im  el  lull  to  f  he  ortglnil  e  urve  -  fli.  signitle.nt 
observations  »hlch  e-  in  be  made  ein  the  bisis  u|  these1  euive-  ir«  the  f<e|l<i.: 

1  The  eeirve  S  ire-  eppi  u.x  l  stale  ty  lin.  U  in  time  III  le>g^  Ve tiles  .11  )  ,»||| 

V,  »hc  re  k  is  the  percent  ige  error  in  ih.  -  *  nut  a  ret  ete  \  t  it  io;\  .»(  t|i, 

ellglt  i/eel  eeivelum  inel  N  IS  the  number  of  e|ll  lilt  1 1 1  l!g  level-  Ihl- 
sugge  s  t  s  the!  the-  re  1  a  I  lunsh  1  p  be  l»<  e  n  1  eiblV  l-  i  I  •  e  t  eogu  1  >r  hyp.  I  - 

boli  The  st  r  eight-line  logj(J  plot  i-  given  by 
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'J  As  the  *  imp  1 1  pg  nil  increases  the-  t  vs  N  e  ell  v*  -  .lie  ,11-plei.il  i  t-  tin 


direction  eit  UeiTe  i<ed  error- 
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These  results  suggest  t  three  dimensional  surf  ice  of  the  form  shown  in 
Figure  3.3.  Equitions  0.1)  ..id  0.2)  nprtunt  tho  S  const  »nt  cross 
sections,  (f  this  surf  tee  ein  be  described  ana tyt lcil ly  the  composite  E-V-S 
relationship  will  hi  known  completely.  This  would  undoubtedly  hr  a  very  useful 
result.  The  following  pir.gr  iph  describe-;  how  tht  t  tnalytictl  expression  w  i« 
obt  un»  d  . 

A*  first  i  rithcr  1  irge  matrix  was  constructed  having  S  rows  and  V  columns. 
f-.U'h  element  m  this  mitrix  w  is  the  error  obt  lined  for  i  pirtlculir  vilue  of 
3  ind  v  which  i  <n  respond  to  the  s<ibsrnpts  of  that  <  lim.  nt  fr.e  points  plottid 
in  figure  3  1  produce  the  eliments  of  row  20  ind  columns  |  to  236  '.'sing  i 
t<  <hni(|U«  similar  to  that  used  *hi  n  S  wis  on<  fix<d  vil'u  the  mtximtim  «rrors 
art  ugun  ordered  but  now  with  resp.  ct  to  troth  imri  istrig  S  .ml  ircreising  -i 
v  i  lues  .  By  using  the  eomputer  to  generite  the  errors  lor  »  uli  v  1 1  tit.  of  S  i«i  N, 
<s  described  in  (hipter  fwo,  *hts  mitrix  w  i-«  const  me-t<  tl  fitilv  easily  md 
<|tnekl y  . 
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After  the  list  element  <  ,  h  id  been  eomputed  anei  stored,  the  se  ireh  lor  the- 

<11 

Itrgest  error  w  is  tmtiiMd.  this  «  <«  rlone  by  eompirtrg  *nt  mignttude-s  of  the 

elements  <  ind  f  ;  l-Jf,  ir.d  stewing  the  litger  number  Jhe  entire  matrix 

t  J  »  t  J  ‘  •  » 

w  is  slimed  in  this  #iv  ind  the  Ingest  v«lu<  was  retimed  ilong  with  ;ts  sub¬ 
scripts.  Suppose  for  example,  thit  was  the  lirgest  olcmed  Then  the 
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magnitude  of  ^  was  stored  as  the  first  element  Ir.  a  new  matrix  with  Its  new 
position  digged  by  S  2  and  Ml.  As  lit  lore  .  the  preceding  elemints 
€ll  ’ ' *  €in'  C2i*  *'»'»•  ^>>3  w*’rc  1«r-f>rcti-  Thc  computer  then  lnuoxed  to  the  next 
element  <1  .c  .  f  ,)  tod  repeated  the  search  procedure  until  the  next  largest  error 
wts  obtained  for  $  >  2  and  M  *•  5.  This  element  was  stored  is  the-  second  element 
of  the>  new  matrix  ilong  with  the  vilues  of  its  sub*  ripts  »s  before  (viz.  S  ind  S’) 
This  search  and  storage  procedure  was  repeated  until  all  the  elements  ot  the 
original  matrix  *<  r<  exhausted.  As  a  result,  the  new  matrix  gives  the  points  «>n 
the  "m  iximum-e  rror  surface  with  respect  to  tncre-asing  values  ul  3  inel  M  It  is 

therefore  i  certainty  t  h  it  for  my  S  .nil  M  within  the  specified  range  the  error 
which  can  lie  expected  i>n  those  coordinates  i»  less  than  or  ec|ii  1 1  to  the  Valin 
given  lav  the'  point  ein  thet  surf  let  .  As  i  result  any  inalysts  based  on  thi*  suf¬ 
fice  gives  |se  results. 

The  next  problem  e,l«  t<*  eabtltn  the  ee|Utt.  t<>n  Ot  the  three  (1 1  lie  ns  1 0114 1  suit  ee« 
from  the  e!it  i  i  on  I  1 1  re  <1  in  the’  matrtx  ot  the  etrehred  maximum  eitoie  flu  curves 
el  r  awn  m  figure  J  I!  hue  (Is  melttst  r  ate  <1  I  f  illlv-Well  dot  tiled  lelltlou  betsee’l  f 
and  M  is  given  by  filiations  (3.11  ind  (3  2).  Dec  oisi  of  the  t("ii«ni  v  to  dt  -place 
the-  curves  in  the  eft  r«ct  lean  <»(  decrevised  error  when  thi  sampling  f'.te  wis  lu¬ 
cre  |se  el,  1 1  is  not  urtle  i»onabte  to  IS  sunt  a  stmt  la*  talettons  hi  I  we.  t  n  f  mu  S 
as  was  issiime d  l an  l  mil  N.  Ir.  three  dimensions  this  results  in  the  eqititloii 

‘o  *  °l  l°*10S  *  °2  lo«lON  <;‘  3> 

Assuming  this  eqiiatto  <le  scribes  the  l.N.3  relation,  the  unkrown  eo-.-t  m.ts 
can  be  found  by  fitting  e  least  squires  surf  ice  to  the  points  m  the  miximum 
error  matrtx.  This  was  dotu  using  i  Multiple  f'cgrcss-.c'n  Analysis  Routine  on  t 
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Control  Data  0-20  computer.  For  the  particular  problem  being  considered  these 
coefficients  were  tound  to  be. 
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The  i'i|u  it  mn  of  thi  three  •dimensional  surf  iu  is  therefore 
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(■'sing  these  equations  tt  Is  possible'  to  obtlld  the  maximum  «rri>rs  HI  -hi¬ 
st  indird  dictation  as  a  (motion  uf  the  sampling  rite  «mi  the  number  o|  quant  1- 
aation  levels.  Uy  allowing  one  oi  the  teims  in  ih<  ibove  .qua turn  to  Ik-  constant 
while  the  other  two  terms  vary,  it  Is  easy  to  not  tin  the  virions  cross  sections 
of  the  surf  in  .  Typical  cross  sections  have  b>  i  n  pint  i  <  1 1  in  t igun s  13,  |.| 
and  16.  Thesi  eurvis  will  bi  i  cammed  and  discuss.  r|  m  thi  nest  section. 


•I-  A  DISCUSSION  OF  THE  OBSERVATIONS 


It  is  important  to  first  examine  Figure  4.1  which  gives  a  comparison  of 
tlu.-  smoothed  curves  obtained  from  the  regression  analysis  routine,  and  the- 
curves  plotted  using  the  raw  data  given  by  the  matrix  of  the  ordered  maximum 
e'rrors,  (ordered  with  respect  to  increasing  N)  .  The  results  art  encouraging 
because'  the  deviation  bctwee*n  the  two  curves  is  relatively  small,  and  over  a 
Urge  portion  of  the  range  of  N  the  regression  lines  lie  ibove  the  actual  mixi- 
mum  errors.  As  a  result,  the  regression  i  vaOinn  nrt  ltnly  yields  worst- 
case  results.  The  curve*  plotted  in  figures  4  2.  4  I,  and  I  fi  ire  also  worst- 
c  isc'  sinet  they  were  obtained  from  the  same-  regression  equttton  is  that  men¬ 
tioned  above  .  Pure  tore  Itguie  It  lends  justification  to  the  ob>e-rv  it  ion- 
Old  eonclustons  mule  on  the  basis  ot  the  curve  a  obtained  using  r '»*  re-gre  ss|e»n 
toe  I  1  I  e'l  e  n  t  s  . 

The-  first  of  these  curves  is  1 1  lust  rate  el  in  Figure  12  which  meins  t  r  ite  s 
the-  i  licet  which  in  »ne  re  »seel  simpling  rite-  h  is  in  reilucing  the  p>  ree-nt  ige- 
e  freer-  tor  i  r  inge-  e*f  viluts  <>|  qll  i’ll  1/4' ion  leVe  l*  In  all  e-.e*c*  tiler*  islllg 

the  simpling  rite'  signi  f  te  int  Iv  reduced  the  errors  m  the  stindird  deviation. 

A  quilltitivr  e  splint  ion  of  this  le-ult  will  b>  given  in  the  tollowing  pai  i- 
graph 

As  his  been  pointed  out  previously  in  eonne-  unn  with  the'  Simpling  Hie  on  m, 
the  statistics  (it  le  ist  those  based  tin  the  first  »nd  *econet  moments)  ot  mv 
waveform  are*  defined  by  lls  power  spectrum.  Simpltng  the  wavelorn  in  time  ein 
be  looked  on  as  using  portions  ot  the  area  under  the-  power  spectrum  tei  compute 
the  statistics,  »|  the  simpling  Irequvney  is  too  leiw.  not  all  ot  the  .re a  under 
the  power  spectrum  t«  utili/e'd  ano  the  resulting  vilues  of  the  statistics  are 
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In  e  rror  .  II  ’he  simpling  frequency  is  high  enough  ill  of  tr.c  no  is  accounted 

for  md  the  stalls'ics  of  the  sampled  and  unjimplcd  wavefonns  in  the  same-  As 

shown  in  figure  1  Ja  the  po*f  t  tpo'iun  lot  ’he  sine  ovr  consists  of  two  spikes' 

at  frequencies  I  i*<J  -I  By  sampling  it  lr>q>unrii«  ijreatrr  than  or  equal  to 

2f  all  of  the  p<r»<  r  spectrum  is  accounted  (or  ird  the  statistics  of  the  sampled 
m 

and  unsampled  sine  wives  ire  th>  s  ime 

It  is  we- 1  l-krown  *  thit  quantizing  the  simp  let!  amplitudes  and  e  pots-  to  the 

wive  torn.  II  Inr  e  i  imp  1 1  this  noi  -<  is  issume-el  to  lie  white  and  Hide  penile  nt 

o(  the-  sine  wives  then  'he  no«er  sp-  tint's  lor  th*  digitized  »  iVe  lorm  looks 

1 1 ke  t  h  it  shown  in  1  igun  |  3b  ;  |  the  » t  i'  !  >•  u  s  tor  this  U ig t  t  i  /■  d  w  ive  Inns 

•  re  to  hi  1  he  s  in  ,»s  those  lor  *he  original  *  tni  wiv<  thin  the  sampling  In* 

queney  souldlieVi  •  n  hi  Irfiritetyhagh  !  '  !«  >i|l  I  |  i  |>  ml  tu  snti  thit  |s  t  In- 

s  imp  1 1  rg  |  I  e  que  t'e  V  e  s  |  he  re  Ise  il  t  o  1 1  to  s  g  r>  1 1  •  t  t  h  ih  t  *.oi  i  ol  t  ni  in  I  unde-  r 

t  h»  powi  r  sp.  t  t  i  u  .  w ;  1 1  be  t  eitts  :  1 1  •;  »-d  •  h  itdinii'  will  ippro  u  h  tori 

close  lv  their  t  i  ut  values  'ht-  neon't-  lor  the  »h  epe  ot  trn  leirves  plottid  m 

fl  gut  e  I  J  Sh  I  e  h  I  .  l*l»  t  r  et  •  t  he  t  e  -'!i  tie  V  o|  t  hi  e  i  I  01  s  to  hi  mUi  I’  i  ■  tin 

sunplthg  rate  is  Utih  lull  lillMel  e  ol'  I  C<  r  it  inn  in  'hi'  reg.eid  i  . be  tow'd 
5  ti 

t  n  the  1 1 1  e  r  it  ure 

Aho'hi"  l"te  testing  lesqll  In.ugn*  out  hv  flgwte  t  1  Ihe'e  e.lies 

lllu'tiite  tin  In1  It.  el  is  I  he  nunlie  t  ot  q  u  ill  t  1 1  it  |  o  •  li  ve  1  s  l  lie.  l  e  l-o  '  Ihi 

pe  re  e  n  t  ige  e  1 1  or  in  the  s  t  *0!!  nit  jivi  .t  io:i  hi  i  i  e  me  !h:  s  result  i  m  be  e  s  - 

plained  using  'he  e""iepl  ol  piobtbilitv  -inn  it  i«  possible  te>  consider  the' 
pcrtutbelton  eel  the  l-plltue.'e  I  r.ihi  ll~  *  n-ple  Vllue  ante  to  the  C|U  Iht  1  /  1 1  ton 
process  is  a  r  uielora  (  lu< ’u  it  ton  Hits  tie  •  i  it  ion  ol  *he  amplitude  i  ium  its  true 
value  Is  due'  to  whit  h  ;s  beer  It  i -"ed  qu  in*;/ it  ton  tui'i 

Iht  amplitude  ot  this  noise  eeemoom  nt  ruiges  <>vi  r  ’he  quih*i/ihg  inleivil 
ara  c  ih  h  ive  itv  vilut  m«ibi  this  mti  t-  %1  with  equil  ptobduliey  figure- 


FiKUI'v  • .  1 


^=aj  .3  illustrate*  thi  behtvior  of  i  iircplr  of  quantization  non*,  the  error  lb 

given  by  the  atlfirene-c  between  the  amplitude  of  the-  actual  wiveform  and  the 

quantized  result.  Obviously  this  error  ranges  from  -  —  to  -  — ■  The  avenge 

error  will  be  zero  the  second  statistical  moment  is  Klvtn  by 
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Si  nee  the  mean  error  is  ,'e  ro  the  I4  MS  i  mu  l«  simply 
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Vsmg  the  definition  hi  the  i|um<winii  inteivil  givvn  in  tin  pienilmg  p 
AV  i  whe  le  M  is  the  number  lit  14O  Pit  I  /  at  lent  |i  Vi  |s  fhi|i|<ire  l  n>  i'i  HI  Hi!  Ih. 
number  of  qu  HU  U  It  in'4  levels  t  e  i  Ul*  »  •  I  he  i  lints  ul  t  he-  <|ei  ill  t  i  /  il  I  nil  llo  l  si  sidii 
thi  itrur  eunt  i  tbut  m«  t*  cut  1 1  •ii.usIimiJ  I  e  smlb  '  is  ib  mnu  t  r  it  <  d  tie  the  n  suli 
just  di  nvid 

The  I  ml  ubhi.  iv  it  ton  *h  1 1  h  «  »n  li*  r  »»l«  u  -  \  *\g  t  hi  "»  it  miIh  m  ik\  ■»  u  "i  ul  t  h* 
i  ui  v\  s  p  lu 1 1 1  (|  in  K : gill  <  I  li  Ai  \  u  » l  1  v  I  ht  N«  I  u  i  \  I  *  uni  Mu  vnt  i  n  I otn  it  i • 

.is,  t  .ilri  ulv  <1  l*M »  ;•»  *  loin  *hi»h  *no  i  .  pi  u  l  !<  ,1  vilu* 

fht  y  1 1  liH  i  ill  thi  u’ti^romi-*  or  '  r  ni«  «>!  I  nbuh  ih  po»ml«li  lit  Unn  tht  mnlf  r 
oi  qu  int  &/.4t  ion  lot  l**  tmJ  thi  «  ir.pl m£  ru*.  to  iimiu  thu  the  pun  ni  uic  error 
i  h  no  mon  t  h  »n  »  vi  1 1  «i  n  ^jn  i  il  inl  v  » lui  Ini  i  x  inp  U  1 1  1 1  4i  it  m  «  :  i  il>K  to 

■»il  I  hi  qu  ill  l/i  r  it  *<  12M  .'Ul  h.iw  4  nor"  li  hs  thin  l.  2  ,  t  h»  ^i£n»l  uouhl 

h  ivi  lo  t*t  S4*npli  tl  1 1  i  »  »t i  $  •  *  "  1'ipLi  •}  p«  i  pi  i  i  .ul  1  oi  vi  i or  ■»  li  s  <  i  h  *n  1 .  I  ' 

thi  a  imp  1 1  t  it  i  miu  Id  hivi  to  hi  irv  u  nul  t<»  5  31  h  |rr;|»  K-  pi  r  pv  I  l<xt  •  I  or  i 
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NUMBER  Of  QUANTIZATION  LEVELS 


inrt.ln  i  oi  t|ti  m*  i  r.  it  ion  livt  li  ilu  lor  r«. '•ponding  simplm;  titt-r  It  »ve  to 
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nu  ll  i><u  « »n •  t <i<  i  d>l  v  i  '  ti  l  K  vi  is 
29  ti'npitu!  * *»  jJ  •  7  i r*  •  h«  pt<  v  c  -i 

’  ill  fiui*  In  ,i'“»*l  «hi  n  i4  i  n  I  t  «iMs 


th»"  lor  ,n  i  nor  !■  «•*  » h  i*t  1,2’  -, 
tor  in  i  i  rot  P  ss  th  it;  t'o 
til-tty  ttlu  *  n  128 


5  CONCLUSIONS 


Iho  curve's  <*(  Figure  •l.-t,  which  hive  dc monst rated  how  the  percentage  errors 
in  the  standard  deviation  between  the  perturbed  and  unperturbed  waveforms  were 
reduced  when  more  quantization  live  Is  were  used,  hive  been  explained  by  treating 
the  quint iz it  ion  process  as  one  which  idds  a  noise  component  to  the  sampled 
amplitudes.  The  advantage  of  this  method  of  analysis  Is  obvious  when  quanti¬ 
tative  rather  than  qualitative  i  xplanal tons  are  desired.  When  noise  is  the  aub- 
jeel  of  a  stitistteil  analysis,  the  results  tmprov.  is  the  number  of  samples 
increases,  ( t  fa  it  is  is  the  number  <>f  quant  i /.it  ton  level-  increases).  Therefore, 
ft  one  is  interested  m  the  formulation  of  4  theoretical  basis  lor  the  sampling 
and  qu  m  1 1  zing  processes,  it  is  the  opinion  of  the  author  thit  this  lormulat  loti 
should  in'  b  iscd  011  th  notion  of  probibllttv  and  st  iit-tiril  thiory.  I**-  furthc*r 
invest  1  g  it  ion  using  this  appro  1.  h  interested  read*  rs  .<  r.  referred  to  the  paper 
tiv  Watts-  which  gtvis  a  t  airly  g-n.  rat  ti'a'm.nt  as  t o  how  on.  might  handle 
stutstleal  qll.lht  1 1  l<  s  wh.  n  the  prmissis  ..:i  which  t  III  v  lie  diluted  tie  subjected 
to  Iwit h  simpling  out  quant  t/.it  loll . 

Throughout  this  pip.-r  u:  utenpt  *1-  id.  .  *h«  never  pos-.tbl.  ,  to  point  out 

Use  |  ill  s  t  it  t  s  t  1 1  1 1  t  e  l  it  tons  to  Mlgg*  s  I  the  I  bU  »pp  1 11  «il  i“U  o|  stillsit.il 

th.orv.  In  rut  thi  nnv.  s  iin.n  In  I’lgutes  |  dl,  I  I,  and  I -il  ire  expr.  ssad  in 
t.  ins  of  the  simple  st  mil  ml  di v  l  it  mil,  It-.  It  abisic  e  t  it  l  st  le  1 1  qu  llU  t  t  y 

The  conclusion**  which  nn  In  driwn  on  the  basis  of  ih>  pnei.ling  work  are 
the  following 

t  III  sine  wive  is  to  I',  simp  lid  .ml  quiuti/cd  tin  relation  lit  twfi  eii  th. 
number  ol  quaint  z  it  ion  levels  mil  tin  sampling  rite  which  nuni  be  u.;cd  to  produce' 
errors  in  the  -imple  st.inlird  cbviition  less  than  a  specified  viltie  is  given  by 
the*  curves  of  f'tgur.  -1 .0*  whi  rc'  .  icli  curve  is  plot  tec)  for  a  constant  vilue  of 


this  *rror. 


2.  The  application  of  the  quantization  process  to  the  aimplcd  waveform 
ha*  the  effect  of  adding  noise  to  that  waveform  The  effects  of  this  r.otsv  are 
reduced  by  increasing  the  number  of  quintization  levels  or  by  increasing  tho 
sampling  rate  to  a  value  In  excess  of  that  specified  by  the  Sampling  Theorem. 

As  a  result  it  is  possible  to  reduce  the  errors  in  the  values  of  thr  statistics 
introduced  by  quantization  by  increasing  the  sampling  rate  beyond  its  lower 
bound 

It.  It  sc<ms  that  the  most  fruitful  ippro.o  h  to  th>'  thcuieticil  study  of 

j 

this  problem  sould  b<  to  extend  the  work  done  by  Wilts”  to  the  ease  she  re  the- 
bounds  ein  the  stapling  rate  and  number  of  qu  ini  la  it  ion  levels  become'  parameter* 
in  the  expressions  for  the  probibltlty  functions.  The-  statistics  could  then  be 
evaluated  as  functions  of  the  s»  perimeters  ind  compered  dirntiy  with  the  t  rm- 
Vllne-s  This  woulil  be  an  eMier-iely  Usilul  result  since'  the-  expressions  for  the- 
digit  t/eel  wave  ims  el-  pe  r.d  primarily  e»n  the  ptnbal't  1  tty  tunet  toils  of  the-  urp.r- 
tuibeel  •  avefeir-x.  The  lesults  would  tiler  tie  applie  eble-  »e»  all  processes  lor 
which  i  probability  distribution  e'ould  be  tounel 
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